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Several networks occurring in real life have modular structures that are arranged in an hierarchical 
fashion. In this paper, we have proposed a model for such networks, using a stochastic generation 
method. Using this model we show that, the scaling relation between the clustering and degree 
of the nodes is not a necessary property of hierarchical modular networks, as had previously been 
suggested on the basis of a deterministically constructed model. We also look at dynamics on such 
networks, in particular, the stability of equilibria of network dynamics and of synchronized activity 
in the network. For both of these, we find that, increasing modularity or the number of hierarchical 
levels tends to increase the probability of instability. As both hierarchy and modularity are seen in 
natural systems, which necessarily have to be robust against environmental fluctuations, we conclude 
that additional constraints are necessary for the emergence of hierarchical structure, similar to the 
occurrence of modularity through multi-constraint optimization as shown by us previously. 
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I. INTRODUCTION 

Structural patterns in complex networks occurring in 
biological, social and technological contexts, have been 
a focus of study by physicists for a decade, since the 
groundbreaking discovery of small- world property [l[ and 
scale-free degree distribution j_2S| for many networks. One 
of the common features seen in many networks is the oc- 
currence of modules, namely, subnetworks whose mem- 
bers are highly inter-connected but have few links to 
nodes outside the module. Many networks have also been 
seen to have hierarchical organization, i.e., they are com- 
posed of successive interconnected layers or inter-nested 
communities. In the literature, often the terms hierarchy 
and modularity have been used almost inter-changeably, 
although, as shown in Fig.[TJ they represent distinct prop- 
erties of the network. However, it is interesting to note 
that these two properties have been found to coexist in 
many networks occurring in real life [US [5, 6], including 
the Internet 0, HI and the network of cortical areas in 
the cat brain Q. 

Most of the complex systems seen in real life also have 
associated dynamics [lOj , and the structural properties of 
such networks have been sought to be linked with their 
dynamical behavior [ll|, [l2(. In this respect, one of the 
questions of obvious significance is whether there is a re- 
lation between the stability of the dynamics against small 
perturbations in the dynamical variables and the specific 
arrangement of the network's connections. If the pertur- 
bation decays quickly, so that it is unable to spread to 
the rest of the network, the network is said to be stable. 
Such a property is necessary if networks are to survive 
the noisy environment that characterizes the real world. 
It has sometimes been argued that, networks with larger 
number of nodes, links and stronger inter-connections are 
more stable. Such assertions are partly based on empiri- 
cal observations, e.g., in ecology, where it has been found 
that more diverse and strongly connected ecosystems are 



more robust than their smaller, weakly connected coun- 
terparts [l3| • On the other hand, theoretical work on the 
stability of model networks have suggested the opposite 
conclusion. In particular, according to the May-Wigner 
theorem [lij for random networks, increasing the com- 
plexity (as measured by the number of nodes, density of 
connections and dispersion of interaction strengths) al- 
ways leads to decreased stability. However, this result is 
based on the study of networks whose connection topol- 
ogy shows none of the structures that are seen in real 
life networks, in particular, modularity and hierarchy. 
Therefore, it is of interest to see whether introducing hi- 
erarchical organization and modular structures can result 
in refutation of the May-Wigner theorem. Early work on 
the stability of simple, structured model networks [l5[ 
seemed to indicate that such structures indeed promote 
stability, and this was also seen under certain conditions 
for hierarchically organized networks (l6| . However, a 
later study of hierarchical, as well as, modular networks, 
concluded that these are less stable than corresponding 
random networks (l7| . We revisit this problem in the 
present paper, by proposing a network model that ex- 
hibits both modular structure and hierarchical organiza- 
tion. In addition to looking at the stability of equilib- 
ria of the network dynamics, we also consider the stabil- 
ity of synchronization over the network. Although these 
two stability phenomena are superficially similar, they in- 
volve looking at different properties of the network. The 
issue of network synchronization, in particular, has as- 
sumed importance in recent years, owing to its connec- 
tion with, e.g., brain dynamics Q. 

An alternative model for hierarchical modular net- 
works has been earlier proposed by Ravasz and Barabasi 
(RB) 18]. This model generates a set of inter- nested 
modules in a hierarchical fashion using a deterministic 
procedure that has both high clustering (because of the 
modular nature of the network at the most fundamen- 
tal level) and a scale-free degree-distribution. These two 



FIG. 1: Schematic diagrams of (left) a modular network, with 
modules demarcated by broken circles, and (right) a hierar- 
chical network with 4 levels, each indicated by a level number 
I. 

properties do not always co-occur in other network mod- 
els that have been proposed in the literature. In partic- 
ular, the Barabasi- Albert (BA) network model [2J allows 
generation of a network with scale-free degree distribu- 
tion through the preferential attachment mechanism, but 
the average clustering coefficient of its nodes decays with 
system size N. Further, in the RB model, a scaling re- 
lation is observed between the clustering coefficient of a 
node C and its number of connections (i.e., degree) k: 

C(k)~k-\ (1) 

Similar relations were also observed in several real net- 
works, such as the web of semantic connections between 
two English words which are synonyms [l8j . This occur- 
rence of the scaling relation between clustering and de- 
gree of the nodes in a network has often been taken as a 
signature for the existence of hierarchical modular struc- 
ture in that network. Recently, this scaling relation was 
shown to be actually an outcome of degree-correlation 
bias in the usual definition of clustering coefficient [l9j |. 

However, it can be easily seen that this scaling rela- 
tion is not a necessary indicator for the existence of ei- 
ther modularity or hierarchy. For example, consider a 
modular network consisting of N nodes and m modules 
of equal size. Let each node have degree fc, with the links 
initially occurring exclusively between nodes belonging 
to the same module (i.e., the modules are isolated from 
each other) . To make the network connected we rewire a 
small fraction of the links keeping the degree of each node 
fixed. Plotting clustering as a function of degree for this 
network will only show vertical spread of points at a sin- 
gle node degree value. Let us consider another example, 
this time a hierarchical structure, viz., the Cayley tree 
with b branches at each vertex. Again, it is easy to see 
that the clustering versus degree curve will not show the 
characteristic scaling seen for the RB model. In fact, in 
the next section, we show that even for networks where 
both hierarchy and modularity are present, it is not nec- 
essary that this scaling relation between clustering and 
node degree will hold. 

The paper is organized as follows. In the next sec- 
tion we introduced a simple model of a modular net- 
work with hierarchical organization. In section IIIII we 



FIG. 2: Schematic diagram of the hierarchical modular net- 
work model (left) with the modules occurring at the various 
hierarchical levels (I) indicated by broken lines, and the cor- 
responding adjacency matrix (right) where pi indicates the 
density of connections within and, pi+i, between the different 
modules at each level I. 



introduce the formalism to analyze the stability of dy- 
namical equilibria and synchronized states of a network. 
The proposed model allows a detailed study of the rela- 
tion between dynamical stability and hierarchical mod- 
ular organization of the network. We observe that both 
of these structural properties actually increase the insta- 
bility compared to an equivalent random network. This 
may appear counter-intuitive as both modularity and hi- 
erarchy are observed in networks occurring in nature, 
which necessarily have to be robust to survive environ- 
mental fluctuations. However, the emergence of modular 
structures can be understood as a response to multiple 
(and often conflicting) constraints imposed on such net- 
works 20]. We conclude with a discussion about how 
these observations can possibly be extended to explain 
the emergence of hierarchical organization. 



II. MODEL OF HIERARCHICAL MODULAR 
NETWORK 

Here we propose a general model for networks having 
modular as well as hierarchical structure. Let us begin 
with a modular network consisting of m modules, each 
containing n nodes. The connectivity (i.e., the probabil- 
ity of a link between any pair of nodes) within each mod- 
ule is pi, while the connectivity between modules is p 2 
(< pi). We now introduce hierarchy by adding another 
set of m modules (each having n nodes) with the same 
pi and p2- The nodes belonging to these two different 
sets of modules are now connected, but with a probabil- 
ity P3 (< p-i)- The resulting network has 2nm nodes and 
I = 2 hierarchical levels (Fig. [2]). To increase the number 
of hierarchical levels to I = 3, we add a similar network 
with 2nm nodes to the existing network and, as above, 
add links between these two networks with a probability 
Pi P3)- Thus, to get a network with / = h hierarchical 
levels, the above procedure is repeated h — 1 times. The 
final network contains M = 2 h ~ 1 m number of modules. 
Note that, all connections between nodes are made ran- 
domly. To reduce the number of model parameters, we 
assume that the connectivities pi,...,ph+i are related 
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FIG. 3: Clustering coefficient C, of the i-th node as a function 
of its degree fc; for the hierarchical modular network model 
proposed here, where each module at I — 1 is (left) a random 
ER network and (right) a scale-free BA network. The dif- 
ferent symbols indicate networks with differing total number 
of hierarchical levels, h. For both types of networks, the to- 
tal number of nodes is N = 8192 with average intra-modular 
degree, (fc n tra) = 10, inter-modular degree, (fenter) = 5, and 
the ratio of inter-modular connections between two succes- 
sive hierarchical levels, r = 0.1. Note that, in neither case is 
a scaling relation observed between d and ki, although the 
modules are arranged in a hierarchical manner by construc- 
tion. 
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where, < r < 1, the ratio of inter- modular connections 
between two successive hierarchical levels, is a control pa- 
rameter. By varying r, one can switch between isolated 
modular (r — 0) and homogeneous random (r = 1) net- 
works, with intermediate values of r giving hierarchical 
modular networks. We compare between networks hav- 
ing different number of hierarchical levels h, keeping the 
total number of modules M and average degree (k) fixed. 

To consider the effect of hierarchy in isolation, while 
keeping modularity fixed (e. g., as measured by the New- 
man modularity measure Q [2l|), we use a variant of the 
above model, where, p\ = constant, while other connec- 
tivities are still related by 
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This implies that the average number of intra-modular 
((fcintra)) and inter-modular ((Winter)) connections per 
node are also constant [281 ]. 

The stochastic construction procedure of this network, 
along with the ability to vary modularity (by changing 



r) independently of the number of hierarchical levels (h), 
makes it an extremely general model. In addition, as 
it is hierarchical by construction, we can show that the 
criterion suggested in Ref. [l8|, namely, the scaling re- 
lation between clustering and degree, is not a necessary 
condition for the existence of hierarchical modularity. As 
shown in Fig. [3] (left), when the modules are random net- 
works, the scaling relation is clearly absent for our model 
network. To counter the possible argument that this fail- 
ure of the relation is due to the non-scale-free degree dis- 
tribution, we have also considered the case where each 
of the modules is a BA network. Although the inter- 
modular connections are made randomly, the network 
degree distribution is still scale-free. Even for this case, 
a clear scaling relation between clustering and degree is 
absent (Fig [31 right). 



III. DYNAMICS ON HIERARCHICAL 
NETWORKS 

A. Linear Stability of Equilibria 

To look at the effect of hierarchy on network dynamics, 
we consider the linear stability of an arbitrarily chosen 
equilibrium state for a set of coupled differential equa- 
tions defining the time-evolution of the system. For a 
network of N nodes, a dynamical variable Xi is associ- 
ated with each node i. The state of the system, x, can 
be characterized by x = /(x), where / is a general non- 
linear function. To investigate the stability around an 
arbitrary fixed point x* (i.e., /(x)| x * = 0), we check 
whether a small perturbation 5x about x* grows or de- 
cays with time. This perturbation evolves as 



fix = Jx, 



(4) 



where, J is the Jacobian matrix representing the inter- 
actions among the nodes: Jy = dfi/dxj\ x *. As we are 
interested in the instability induced through the connec- 
tions of the network, rather than the intrinsic instability 
of individual unconnected nodes, we can (without much 
loss of generality) set the diagonal element J a = — 1. 
This implies that, in the absence of any connections, the 
nodes are self- regulating, i.e., the fixed point x* is sta- 
ble. The behavior of the perturbation is determined by 
the largest real part, A max , of the eigenvalues of J. If 
A max > 0, an initially small perturbation will grow ex- 
ponentially with time, and the system will be rapidly 
dislodged from the equilibrium state x* . 

The relation between the dynamical properties and the 
static structure of the network is provided by its adja- 
cency matrix A (with Ay = 1, if nodes i and j are con- 
nected, and otherwise). There is a direct correspon- 
dence between the nature of the matrices J (specifying 
the dynamical behavior of perturbation) and A (which 
determines the structure of the underlying directed net- 
work), because Ay = implies Jy = 0. In our model, we 
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FIG. 4: (Left) Probability distribution for the largest real 
part of the eigenvalues of the Jacobian J, as a function of to- 
tal number of hierarchical levels, h (the interaction strength 
parameter, a 2 — 0.05). (Right) Probability of stability for 
a hierarchical modular network as a function of a 2 , with 
different symbols corresponding to differing total number 
of hierarchical levels h. Link weights are chosen from a 
normal(0, a 2 ) distribution. For all cases, the network con- 
sists of N = 256 nodes with average intra-modular degree, 
(fantra) = 10, inter-modular degree, (fcinter) = 5, and the ratio 
of inter-modular connections between two successive hierar- 
chical levels, r = 0.1. At all hierarchical levels I > 1, the 
network is split into two sub-networks. At I = 1, each sub- 
network is split into m modules (I = 0). Thus, TV = 256 
nodes are divided equally among 2 h ~ 1 m = 16 modules, with 
the four curves corresponding to (□) h — 4, m — 2, (y) 
h = 3, m = 4, (o) h = 2, m = 8, and (o) h = 1, m = 16. Note 
that, increasing h causes the transition to instability to occur 
at a smaller value of a 2 , implying that increasing hierarchy 
increases instability. 

have generated Jij by randomly choosing the non-zero el- 
ements from a Gaussian distribution with zero mean and 
variance a 2 . For Erdos-Renyi (ER) random networks, J 
is an unstructured random matrix and the largest real 
part of its eigenvalues, A max ~ yj Npa 2 — 1, where p is 
the connectivity of the network, and a measures the dis- 
persion of interaction strengths When any of the 
parameters, N, p, or a, is increased, there is a transition 
from stability to instability. The critical value at which 
the transition to instability occurs is a c ~ 1/ y/Np. This 
result, implying that complexity promotes instability, has 
been shown to be remarkably robust with respect to var- 
ious generalizations [H, [H, [24], [2{| . 

Here, using the above formalism, we examine the effect 
of hierarchy on the stability of equilibria when one of the 



FIG. 5: (Left) Probability distribution of eigenvalues of the 
Laplacian L, as a function of the total number of hierarchical 
levels, h (r = 0.1). (Right) The ratio of the largest eigenvalue 
(Ajv) to the second smallest eigenvalue (A2) as a function of 
r, the ratio of inter-modular connections between two suc- 
cessive hierarchical levels, with different symbols correspond- 
ing to differing total number of hierarchical levels h. For all 
cases, the network consists of JV = 256 nodes with average 
intra-modular degree, (fcmtra) = 10 and inter-modular degree, 
(fcnter) = 5. At all hierarchical levels I > 1, the network is 
split into two sub-networks. At I = 1, each subnetwork is split 
into m modules (I — 0). Thus, N — 256 nodes are divided 
equally among 2 h ~ 1 m — 16 modules, with the four curves 
corresponding to (□) h = 4, m = 2, (v) h = 3, m = 4, (o) 
h = 2, m = 8, and (o) h = 1, m = 16. Note that, increasing 
the number of hierarchical levels leads to divergence of the 
eigenratio, implying that synchronization becomes harder to 
achieve. 

network parameters (namely, a) is varied. We study the 
critical value at which the transition to instability occurs, 
cr c , as a function of the total number of hierarchical levels, 
h, keeping the total number of modules M fixed. We find 
that, with increasing h, the distribution of X ma x shifts 
towards more positive values (Fig. [4] left). As the system 
becomes unstable when X ma x > 0, it follows that the 
probability of stability for the network decreases with 
increasing number of hierarchical levels (Fig. [U right). 



B. Synchronization 

It is of interest to look not only at the stability of 
equilibria for network dynamics, but also at the stability 
of synchronized activity in networks. Let us consider a 
network of N identical oscillators. The time-evolution of 
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this coupled dynamical system is described by: 

n 

ij = F(xj) + e)^Lijll(xj). (5) 

3=1 

Here, is a variable associated with node i; F and H 
are evolution and output functions, respectively; e is the 
strength of coupling; and L is the Laplacian matrix, de- 
fined as: La — ki, the degree of node i, L\j = — 1 if 
nodes i and j are connected, otherwise. It has been 
shown that the linear stability of the synchronized state 
x s (=xi = ... = xjv) can be determined by diagonal- 
izing the variational equation (Eq. [5]) into N blocks of 
the form, y\ = [DF(s) + e\iDH(s)]yi, where yi repre- 
sent different modes of perturbation from the synchro- 
nized state. This is also referred to as the master stability 
equation These equations have the same form but 

different effective couplings on = e\. The synchronized 
state is stable, i.e., the maximum Lyapunov exponent 
is in general negative, only within a bounded interval 
[a^tOe] Hl|. Let the eigenvalues of the Laplacian ma- 
trix be arranged as = Ai < A2 < • • ■ < A n . Then, 
requiring all effective couplings to lie within the interval 
a a < eA2 < ■ ■ • < eAat < cub, implies that a synchronized 
state is linearly stable, if and only if, < cib/ola- 

Thus, a network having a smaller eigenratio is 
more likely to show stable synchronized activity. 

Here, we obtain the eigenvalues of the Laplacian L for 
a hierarchical modular network (Fig. left) and observe 
the eigenratio as a function of ratio of the inter- 

modular connections between two successive hierarchical 
levels, r, and the total number of hierarchical levels, h. 
First, keeping the number of hierarchical levels fixed, we 
vary the parameter r. We find that with decreasing r, 
i.e., as the number of connections between two successive 
hierarchical levels decrease, the instability of the synchro- 
nized state increases. Next, keeping the total number of 
modules fixed we increase the number of hierarchical lev- 
els (h) in the network. Fig. [5] (right) shows that as the 
number of hierarchal levels of the network is increased, 
A2 decreases, resulting in an increasing eigenratio. Thus, 
arranging the modules of a network in a hierarchical fash- 
ion also makes a network difficult to synchronize. 

IV. DISCUSSION AND CONCLUSION 

In previously published work |2Qj ] , we have shown that 
increased modularity in random networks leads to higher 
probability of instability for the equilibria of the network 
dynamics. Thus, the work presented here is an exten- 
sion and generalization of the above result, demonstrat- 
ing that increased number of hierarchical levels also tend 
to destabilize these equilibria, and moreover, the same 
phenomena is observed for the stability of synchronized 
activity in a network with respect to increased modular- 
ity and hierarchy. This raises the question of how can 
systems with hierarchical modular structures be seen in 




FIG. 6: Schematic diagram indicating the different types of 
optimal networks obtained by satisfying different constraints. 
Each vertex represents networks obtained by satisfying a pair 
of constraints. Note that, modular networks emerge by opti- 
mizing all three constraints, viz., cost, efficiency and stability, 
indicated by the three arms of the triangle. 



nature at all, where they have to be robust enough to 
survive constant environmental fluctuations. An answer 
to this can be fashioned along the lines of our recent work 
showing that additional natural constraints operating on 
networks in real life, such as the minimization of (a) re- 
source cost for maintaining each link and (b) the time 
required for communicating between nodes, in addition 
to linear stability of equilibria, will make modular net- 
works the optimal configuration (Fig. [S]) [20]. We find 
such stable, modular networks to possess multiple hubs 
and a heterogeneous degree distribution. Many types of 
networks, including scale- free networks 0], can be seen 
as special cases of this general criterion. Therefore, we 
can understand the large-scale occurrence of such net- 
works in nature as a response to co-existing structural 
and dynamical constraints. 

One can ask, what will be the effect of introducing 
constraints other than the ones mentioned here. For ex- 
ample, replacing the criterion for linear stability by one 
demanding robustness with respect to removal of links 
(selected by using a combination of random and targeted 
attack strategies) does not qualitatively change our re- 
sults. It turns out that this criterion is satisfied by net- 
works with bimodal degree distribution, a property that 
our optimal modular networks possess. However, while 
this can explain the ubiquity of modularity, it does not 
answer the question of why hierarchical organization is 
so common in nature. The fact that tree-like networks 
with extensive ramifications occur so often in the con- 
text of resource transport (e.g., the circulatory system in 
plants and animals) suggest that additional constraints 
related to flow maximization may be at work in this 
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case. Another possible candidate for such a constraint 
may be the need to minimize wiring cost, i.e., the total 
link length [27j ■ This is applicable when the network is 
embedded on a geographic (as opposed to topological) 
space, so that the wiring cost can been defined as the 
sum of the Euclidean distances between all connected 



pairs of nodes. As many of the networks showing hierar- 
chical organization (such as the internet and the network 
of cortical areas in the brain) are indeed defined in metric 
space, this is a possibility that needs to be analysed in 
detail. 
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